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Abstract 

A uniform key renewal theorem is deduced from the uniform Black- 
well's renewal theorem. A uniform LDP (large deviations principle) for 
renewal-reward processes is obtained, and MDP (moderate deviations 
principle) is deduced under conditions much weaker than existence of 
^ | exponential moments, 
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Introduction 

An ordinary renewal-reward process £>(•) is a process of the form 

S(t) = X 1 + ■ ■ ■ + X n for n + ■ • ■ + r n < t < n + • ■ ■ + r n+1 ; 

here (ti, Xi), (r 2 , X 2 ), ■ ■ ■ are independent copies of a pair (r, X) of (generally, 
correlated) random variables such that r > a.s. 

Large deviations principle (LDP) for S{t) (as t —> oo) is well-known 
when t and X have exponential moments. Otherwise the large deviations 
have peculiarity disclosed recently I prove moderate deviations principle 
(MDP) for S(t) requiring 

(1) Er<oo, 

(2) E exp(eX 2 — r) < oo for some e > 
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rather than E exp(e|X|) < oo, E exp(er) < oo. An example: X = y/r; MDP 
holds whenever Er < oo. 

Conditions (QQ), ([2]) imply EX 2 < oo and are invariant under linear trans- 
formations of X and rescaling of r (see Remarks 13. 1\ 13 .2[) . thus, we may 
restrict ourselves to the case 

(3) EX = 0, EX 2 = 1, Er = l. 
Theorem 1. If (j2J), (EJ) are satisfied then 

lim llnP(5(0>xVt) = -i. 

a;— »oo,a;/\/i— ^0 X ^ 

The limit in two variables t, x is taken; that is, for every e > there 
exists 5 > such that for all £, x satisfying x > 1/5, xj\fi < 5 the function 
is e-close to the limit. 

Theorem [1] (MDP) will be deduced from Theorem [3l and Theorem [3] 
extends Theorem [2] (uniform LDP). The assumption for Theorem[2]is weaker 
than (|2j): 

(4) VAGlVe>0 E exp(AX - er) < oo . 

(In combination with ([T]) it implies E |X| < oo, see Remark 12.51 ) 

Theorem 2. If ([I]), (jlj) hold and EX = then for every A, first, there exists 
one and only one i]\ G [0, oo) such that 

(5) E exp(AX - r] X r) = 1 ; 
and second, 

(6) ^lnE expAS(t) = r] X + o(- 

as t — > oo, uniformly in A G [-C, —c] U [c, C] whenever < c < C < oo. 
Theorem 3. If © and (J3J hold then 

= ^A 2 + o(A 2 ) as A -> , 
and (jSJ) holds uniformly in A G [— C, C] whenever < C < oo. 
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1 Uniform renewal theorems 



A uniform version of Blackwell's renewal theorem is available [51 Th. 1], [Tj, 
Th. 2.6(2), 2.7] and may be formulated as follows. 

First, we define the span of a probability measure fi on (0, oo) as 

Span(» = max({<5 > : ^({5,25,35,...}) = 1} U {0}) ; 

Span(/i) = if and only if fi is nonlattice. A set M of probability measures 
on (0, oo) will be called a set of constant span 5, if Span(/i) = 8 for all 
/i G M. Symbolically: Span(M) = 5. Thus, a set of constant span contains 
only nonlattice measures; a set of constant span 5 > contains only lattice 
measures of span 5 (rather than 25, 36, . . . ). 

Second, for every probability measure /i on (0, oo) we introduce the re- 
newal measure as the sum of convolutions: 

oo 

(1.1) u„ = 

n=0 

(the term for n = being the atom at the origin); is not finite but locally 
finite, since / e-*£/„(dt) = £«(/ e"V(dt)) n < oo. It is well-known (see [21 
p. 123]) that Ufj,{{u,u + v]) < £^([0, v]) and moreover, 

(1.2) U^{u,u + v\) < U^([0,v)) for all u, v > . 

1.3 Theorem. ([5], [TJ) Assume that a set M of probability measures on 
(0, oo) is weakly compact (treated as a set of measures on R), is a set of 
constant span, and is uniformly integrable, that is, 



lim sup / t fx(dt) = . 

a^+oo M£M J [a oQ) 

Then in the nonlattice case (Span(M) = 0), for every v > 0, 

v 

Uj[u,u + v)) -)■ -y- - — as u ^ oo 

J M d 

uniformly in /i G M; and in the lattice case (Span(M) = 5) 



uniformly in fi G M. 
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The uniform integrability of M ensures continuity of the function /x h-> 
J t fi(dt) on M. We denote for convenience 

1 

A, 



" /*/*(d*)' 
by compactness, 

(1.4) < min A u < max X u < oo . 

A uniform version of key renewal theorem follows. We start with the lattice 
case. 

1.5 Theorem. Let M be a set of probability measures on (0, oo) satisfying 
the conditions of Theorem 11.31 Span(M) = 5 > 0, and H a set of functions 
{0, 5, 25, ...}—>• R such that 



sup > 1^(^5)1 < oo and lim sup > \h(k5)\ = 0. 

L,7T ' ^ 11-400 L^TT ' ' 

Then 



fteff r - : n ^°° hex? ' 

K=0 fe=n 



(i7 M * h)(n5) 5A M ax(/c<5) as n — > oo 

fc=0 

uniformly in /z G M and h E H. 

Proof. By (OIL ^({ntT}-) < £/ M ({0}) = 1 for all /x and n. By Theorem 
11.31 ?7 M ({n<5}) — > 5A M as n — > oo, uniformly in /x G M. Lemma [1.61 (below) 
completes the proof. □ 

1.6 Lemma. Let U and H be sets of functions {0, 1, 2, ...}—>■ R such that 

sup sup \u(n)\ < oo , 

u£U n 

the limit xx(oo) = lim u(n) exists uniformly in xx G U ; 

n— »oo 

sup > \h(n)\ < oo ; 
hex? 



— >■ as N — > oo , uniformly in h E H . 

n=N 

Then 

oo 

(xx * xx(oo) /x(/c) as rx — > oo , uniformly in xx G Z7 and ax G if . 



k=0 
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Proof. Denoting Wu]]^ = sup„ \u(n)\, ||/i||i = Y. n \K n )\ and %(h) = E„ M n ) 
we have ||u * < ||w||oo||^||i) | (oo) | < ||m||oo and |S(/i)| < \\h\\i. For 
arbitrary N E {0, 1, 2, ... } and h G H we introduce fo/v, h N : {0, 1, 2, . . . } — > 
R by /iAr(n) = /i(n) for n < N, /i7v(n) = for n > N, and /i^ = h — h^. 

We have sup ug(7 ||w||oo < °°! su Phe# Il^lli < °°> an d su PfceH ll^lli — ^ as 
N — > oo. For arbitrary N and all n> N, 

\(u*h)(n) -u(oo)E(h)\ < 

< \(u * /ijv)(n) - u(oo)E(/ijv)| + |(u * ^)(n) - u(oo)E(/i Ar )| < 

N N 

< \J2 U ( U ~ k ) h (k) - u{oo)J2Hk) + \(u*h N )(n)\ + \u(oc)Z{h N )\ < 

k=0 k=0 

N 

< H n ~ k )- u{oo)\\h{k)\ + ||u * ^Hoo + |m(oo)||S(^)| < 

fc=0 

< \\h\\i sup \u(k) — u(oo)\ + 2||-u|| 00 ||/i Ar || 1 ; 

k>n-N 

given e > 0, we choose N such that IMIooll^Hi < £ for all G £/ and h <E H; 
then for all n large enough we have \\h\\i sup k>n _ N \u(k) — u(oo)\ < e for all 
u G U and h E H, and finally, |(u * h)(n) — -u(oo)E(/i)| < 3e. □ 

The nonlattice case needs more effort. Recall that a function h : [0, oo) — > 
R is called directly Riemann integrable, if two limits exist and ere equal (and 
finite): 

oo oo 

lim 5y inf h(-) = lim 5 > sup h(-) . 

1.7 Definition. A set H of functions [0, oo) — > R is uniformly directly Rie- 
mann integrable, if 

oo 

sup sup \h(-)\ < oo , 

heH n=Q [n,n+l) 

oo 

sup — > as A — > oo , uniformly in h & H ; 

n=N [™' n+1 ) 

oo 

5 ( SU P h(-) — inf h(-) ) — >■ as 5 — > 0+ , uniformly in /i G H . 

~^ ^ [n<5,n<5+<5) [n5,nS+S) 



n- 



1.8 Remark. If sup ftgH J^^o su P[n<5,ri<5+<5) < 00 f° r some 5 then it holds 
for all 5. Proof: given 5i,5 2 > 0, we consider A = {(ni,n 2 ) : [ni5 1 , riiSi + 
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Si) n [n 2 5 2 , n 2 5 2 + S 2 ) ± 0}, note that #{n x : (n u n 2 ) E A} < ^ + 2, and get 

oo oo 

2 sup \h(')\ — z_, max SU P — 

^ [mSi,mh+Si) J ^ ™2 : ( n i' n 2) eA [n 2 <5 2 ,7i2<52+5 2 ) 

X oo 

< su p woi< (/+ 2 ) E su p imoi- 

(m,na)eA ["2<52,n 2 52+<5 2 ) V0 1 n2=0 [n 2 <5 2 ,n 2 <5 2 +5 2 ) 

Thus, the first two conditions of Def . 11.71 may be reformulated as 

sup sup \h(-)\ < oo , 

h£H n=Q [nS,n8+8) 

oo 

sup — > as iV — > oo , uniformly in h E H 

n=N {nS,nS+6) 

for some (therefore, all) 5 > 0. 

1.9 Remark. Similarly, 

oo 

5 E ( sup /»(.)- inf Zi(.)) <(1 + 25)E sup |/i(.)|. 

~T,u V [n<5,n<5+5) [n<5,n5+5) / AT \n,n+l) 

n:nb>N 1 ' ' n=N <- ' ' ' 

Thus, the third condition of Def. 11.71 may be reformulated as uniform Rie- 
mann integrability on bounded intervals: for every N, 

S y ( sup h(-)— inf h(-) ) — > as 5 — > 0+ , uniformly in h E H . 

n>t?5<N V [n5 ' n5+S) J 

1.10 Remark. If each h E H is a decreasing function [0, oo) — y [0, oo) then 
H is uniformly directly Riemann integrable if and only if 

/■oo 

sup h(0) < oo , sup / h(s) ds < oo , and 
heH heH Jo 

POO 

sup / h(s) ds — > as a — > oo . 

h£H J a 

By taking differences, a similar result can be obtained for functions of uni- 
formly bounded variation on [0, oo) (rather than decreasing). 

1.11 Theorem. Let M be a set of probability measures on (0, oo) satisfying 
the conditions of Theorem 11.31 Span(M) = 0, and H a uniformly directly 
Riemann integrable set of functions [0, oo) — > R. Then 

poo 

(Up * h){t) — > A M / h(s) ds as t — > oo 
Jo 

uniformly in fi E M and h E H. 
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Here is a generalization of Lemma 11.6} to be used in the proof of the 
theorem. 

1.12 Lemma. Let H be as in Lemma [L6| and V a set of functions {0, 1, 2, . . . } x 
[0, oo) — > M. such that, first, sup„ gy sup n sup t |f n (t)| < oo, and second, the 
limit t>(oo) = lim^oo v n (t) exists uniformly in v G V for every n, and does 
not depend on n. Then 

oo oo 

h(n)v n (t) — > v(oo) h(n) as t — >■ oo , uniformly in v G V and h G H . 

n=0 n=0 

Proof. The proof of Lemma ITTBl needs only trivial modifications: Yl n h( n ) v n (t) 
instead of (u * h)(n); Y^n=o \ v n(t) ~ v (.°°)\\h{ n )\ instead of ^2^ =0 \u(n — 
k) — u{oo)\\h{k)\; and max n=0v . _ >N \v n (t) — v(oo)\ (for large t) instead of 
sup fc>n _ Af \u(k) — u(oo)\ (for large n). Also, ||f ||oo = sup nt |u n (*)|- D 

Here is a special case of Theorem 11.111 for step functions. 

1.13 Lemma. Assume that M and H are as in Theorem 11.1 If 5 > 0, and 
every h G H is constant on each [n5, n5 + 5). Then the conclusion of Theorem 
HTD holds. 

Proof. Lemma 11.121 will be applied to H and V, where H consists of all h of 
the form h(n) = h(nS) for h G H, and V consists of all v of the form 

Vn(-) = U,j, * t[nS,n8+8) 

for fie M; that is, v n (t) = U^{{t -n5-6,t- n5]). By (TP]) . 

v n (t) < ^([0,5)) < e 5 j e-°U»(ds) = x _ jl-.^y 
by compactness of M, 

e s 

sup\v n {t)\ < - < oo. 

«,n,t 1 - max M J e s /x(ds) 

By Theorem \1.'S\ for every n, v n (t) — > X^5 as t — > oo, uniformly in v. Thus, 
V satisfies the conditions of Lemma 11.121 By Remark II. 8[ H satisfies the 
conditions (for H) of Lemma [1.12[ that is, of Lemma [L6l It remains to apply 
Lemma H. 121 and take into account that v (oo) = \^5, 5 J2 n M n ) = Jo°° ^( s ) ^ s 
and h(n)v n (-) = Ufj,*h since £) n /i(n5)i[ n(5 ,„5+5) = h. □ 
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Proof of Theorem For arbitrary 5 > and h G H we introduce h s : 

[0, oo) ->• R by 

hj(t)= inf /i(-) , hj(t) = sup /*(•) for t G [n<5, n<5 + <5) , 

[n<S,n<H-5) ' [n<5,n5+5) 

then < h < hj. The sets = {/i^ : h G = {hf : h G H} 

are uniformly directly Riemann integrable by the arguments of Remarks 11.81 
11.91 Applying Lemma [1.131 to M and Hf we get 



h s (s) ds as t — 7- oo 



uniformly in fi G M and h E H . 

Given e > 0, we choose 5 = <5 e such that J \h s (t) — h(t) \ dt < e for all 
h G H. Then we choose t £ such that for all t >t E , jj, G M and ft, G if, 







We get 



{U ll *h)(t)-X lt J h(s)ds< 

POO . poo POO 

<(U,*hj)(t)-Xj hj(s)ds + Xj hj(s)ds- h(s)ds 
Jo v 7o Jo 



< 



< e + X^e 



and a similar lower bound; thus, using (IT 



(C/ M */i)(t)-A M / /i(s)ds 
for all t>t E , /i G M and h e H. 



< s ( 1 + max A, 



□ 



2 Uniform large deviations 

Theorem [2] is proved in this section. 

Exponential moments of a renewal-reward process boil down to a renewal 
equation, see [31 Th. 5], and therefore to an auxiliary renewal process, as 
sketched below. 

Having r]\ satisfying fl^D for a given A, we introduce a random variable T\ 
distributed so that 

(2.1) E/(r A )=E(e^7W) 
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for all bounded Borel functions / : R — >■ R. That is, 

t is distributed /i, r A is distributed fi\, 

(2 ' 2) ^(r)=E(e^-|r). 

d/x v 1 

Then, using the notation E (Z; A) = E {Z ■ 1^), we have 

E (e A5 W; n + • ■ ■ + r n < t < n + ■ ■ • + r n+ i) = e"**E h x (t - r A)1 r A , n ) 

where r A1 , r A)2 , • • • are independent copies of r A , and 



e-^*P (r A > t) fort>0, 
for t < 0. 



(2.3) h x (t) 
Summing up we get 

oo 

(2.4) Ee A5 « = e^'^E^t - t a ,i r A ,„) = e^(U x * /i A )(t) ; 

n=0 

here t/ A = U^ x is the renewal measure (recall (II. ip ). 

Recall assumptions CQ) E r < oo and (0} VA G R Vfe > E exp(AX - 
er) < oo. 

2.5 Remark. Assumptions ([T]), (jlj) imply E|X| < oo. 

Proo/. |X| < t + e |x| ~ r < r + e~ x ~ r + e x ~ T is integrable. □ 

From now on, till the end of this section, we assume the conditions of 
Theorem El that is, ©, gj), and EX = 0. We also assume that P(X = 
0) 7^ 1; otherwise Theorem |2] is trivial. 

2.6 Lemma. Maps (A, r]) (->■ exp(AX — rjr) and (A, 77) 1— >■ rexp(AX — ryr) are 
continuous from R x (0, 00) to the space L\ of integrable random variables. 

Proof. It is sufficient to prove the continuity on [— C, C] x [2s, 00) for arbitrary 
C, e > 0. Also, it is sufficient to consider the map (A, 77) (-)■ e er exp(AX — r)r), 
since r < — e £T a.s. We apply the dominated convergence theorem, taking 
into account that exp(— CX — er) + exp(CX — er) is an integrable majorant 
of e £r exp(AX - r]r) for all A G [-C, C] and r) G [2e, 00). □ 

2.7 Lemma. For every A there is one and only one rjx satisfying (jSJ) E exp(AX- 
7/ A r) = 1, and the function A t— >• 7/ A is continuous on R. 
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Proof. The function if) : Rx(0, oo) — > (0, oo) defined by ip(X, rj) = E exp(AX— 
t]t) is continuous by Lemma [2.61 For every A the function ^(A, •) is strictly 
decreasing, ip(\, +00) = 0, and (possibly, infinite) -?/>(A,0+) = E exp AX > 
expAEX = 1 provided that A 7^ 0. Thus, for A 7^ we get unique rjx > 0; 
and trivially, 770 = 0. 

It remains to prove continuity of the function A 1— > rjx. Given Ao 7^ and 
e < r]x we note that ip(\o, r]x +e) < 1 = ip(\o, 77a ) < "^(Ao, V\o ~ £ ) an d take 
5 > such that ip(\,r]x + e) < 1 — ip(\,r]x) < ip(X,rix — e) and therefore 
r/x — s < rjx < i]x + £ for all A G (Ao — 5, Xq + 5). For Ao = we use a 
one-sided version of the same argument: given e > 0, we take 5 > such 
that ?/>(A, e) < 1 and therefore r/x < £ for all A G (—5, 5). □ 

Recall measures fi, fix given by (I2.2p . 

2.8 Lemma. The function A h-> fi x is continuous from (—00, 0) U (0, 00) to 
the space of measures with the norm topology. 

Proof. We have dfix/dfi = <p\, where <p\ is defined by (fx(r) = E (e xx ~ VxT | r) . 
If A n — > A 7^ Othen, using Lemmas [231 and 12. 71 \\fix n — Ma II — / \^x„— ¥\\ d/i = 
E I^A„(r) -<px(T)\ = E|E(e A " x -^ r |r) - E ( e xx ~^ T | r) | < E|e A « x ^« T - 
e AX-r? A r| as n OO. □ 

2.9 Lemma. The set {/i A : A G [— C, — c] U [c, C]} satisfies the conditions of 
Theorem 11.31 whenever < c < C < 00. 



Proof. Lemma 12.81 ensures compactness (even in a topology stronger than 
needed). For every A measures fix and fi are mutually absolutely continu- 
ous, therefore Span(/i A ) = Span( / u). It remains to prove uniform integrabil- 
ity Using fl2U) we have f [apo) t^(dt) = E (t a ]1 Koo) (t a )) = E (rexp(AX - 

^AT)l[ ai0O )(r)) — )■ as a — >■ 00 uniformly in A G [-C, —c] U [c, C], since ran- 
dom variables rexp(AX — t^t) for these A are a compact subset of L\ by 
Lemmas 12.61 12.71 □ 

Recall functions h x given by ( 12. 3p . 

2.10 Lemma. The set {hx : A G [— C, — c] U [c, C]} is uniformly directly 
Riemann integrable whenever < c < C < 00. 

Proof. Follows from Remark 11.101 fll-4[) and the uniform integrability of mea- 
sures //a, since /ia(0) < 1 and 

poo poo poo 

I h x (t)dt= / e' Vxt ¥ (t x > t) dt < / ^ A ((t, 00)) dt = 

J a J a J a 



(t-a)fi x (dt) < I tfi X (dt). 

[a, oo) 
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□ 

2.11 Lemma. The map A h- y h\ is continuous from (— oo,0) U (0, oo) to 
Li(0,oo). 

Proof. For every t > 0, h\(t) = e~ Vxt nx((t, oo)) is continuous in A ^ 
by Lemmas \2.7\ 12.81 Also, h\(t) < 1. Thus, A >->■ hx|(o,a) e -^i(0,a) is 
continuous (by the dominated convergence theorem). The limit as a — > oo is 
locally uniform around a given A ^ due to the uniform integrability of h\ 
(proved in Lemma I2.10p . □ 

Functions h\ as elements of Li(0, oo) are relevant in the nonlattice case, 
when Span(/i) = 0, while in the lattice case, when Span(/i) = 5 > 0, we treat 
sequences (hx(k5))^ =0 as elements of the space l\ of summable sequences. 

2.12 Lemma. Let Span(/x) = 5 > 0, then the map A i-> (hx(k5))^L is 
continuous from (— oo, 0) U (0, oo) to l\. 

Proof. We have 

h x (k5) = - / e^-^hx^dt, 

° JkS 

since the function t (-)■ e Vxt hx(t) = fJL\((t, oo)) is constant on [kS, kS + S). We 
apply Lemma [2. 1 H taking into account continuity of A t— > r)x- □ 

Proof of Theorem [JJ Existence and uniqueness of rjx satisfying (J5J are en- 
sured by Lemma 12.71 

We reformulate (EJ) as existence of T £ (0, oo) such that 



(2.13) sup -r/ A t + lnEe A5W 

Ae[-C,-c]U[c,C7],te[T,oo) 



< oo . 



The set M = {fix '■ A G [— C, — c] U [c, C]} satisfies the conditions of 
Theorem II .31 by Lemma [2.91 

Bv ll.41 J t (A\(dt) is bounded away from and oo for A G [— C, — c] U [c, C]. 
The rest of the proof of (12. 13[) splits in two cases. 

Nonlattice case: Span(/x) = 0. 

The set H = {hx : A G [— C, — c] U [c, C]} is uniformly directly Riemann 
integrable by Lemma 12.101 By (12. 4p and Theorem 

J SfM X {ds) 

uniformly in A G [— C, — c] U [c, C]. In order to get (12.131) it remains to 
check that the right-hand side is bounded away from and oo. For the 
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denominator, see above. For the numerator, use continuity of the function 
A h-> J o °° h{t) dt for A ^ (Lemma MM- 
Lattice case: Span(/x) = 5 > 0. 

The set H of restrictions to {0, S, 25, ... } of the functions h\ for A G 
[-C, — c] U [c, C] satisfies the conditions of Theorem 11.51 by Lemma T2.12I (via 
compactness in li). By (12.41) and Theorem 11.51 

J s/i A (ds) 

uniformly in A G [— C, —c] U [c, C]. The function A J2T=o ^a(^) is continu- 
ous for A 7^ by Lemma T2. 121 therefore the sum is bounded away from and 
oo for A G [— C, —c] U [c,C] (it cannot vanish since h\(0) = 1), which leads 
to (I2.13p . Thus we get (12. 13[) for t running on the lattice, which is enough, 
since S(-) is constant on [kS, k5 + 5) (and r]\ is bounded). □ 



3 Moderate deviations 

Theorems [1] and [3] are proved in this section. 

In order to use small A we need ([2]): E exp(eX 2 — r) < oo for some e > 0. 

3.1 Remark. Assumptions (JI]), ([2]) imply EX 2 < oo. 

Proof. eX 2 < r + e eX2 ~ T is integrable. □ 

3.2 Remark. Assumption ([2]) is invariant under linear transformations of 
X, and rescaling of r; also, (|2]) implies @. 

Proof. Rescaling X: E exp((c~ 2 e)(cX) 2 - r) = E exp(eX 2 - r) < oo. 

Shifting X: E exp(f(X + c) 2 - r) < E exp(f(X - c) 2 + § (X + c) 2 - r) = 
e c2e E exp(eX 2 - r) < oo. 

Rescaling r: E exp(c^X 2 — cr) = E (exp(^X 2 - r)) c < (E exp(eX 2 - 
r)) c < oo for c G (0, 1), and E exp(eX 2 - cr) < E exp(eX 2 - r) < oo for 
c G [1, oo). 

Finally, ([2]) implies (jl]) since E exp(<5X 2 — r) < oo implies E exp(eSX 2 — 
er) < oo (assuming < e < 1) and therefore E exp(AX — er) < E exp(^ + 
e5X 2 - er) < oo. □ 

From now on, till the end of this section, we assume the conditions of 
Theorem El that is, ©, and (\3§: EX = 0, EX 2 = 1, Er = 1. Conditions of 
Theorem [2] follow, since (|2]) implies (j4j) by Remark 13.21 

Here is an analytic fact that will give us some integrable majorants. 
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3.3 Lemma. For all a,e,Ae (0, oo), 

(1 + t + x 2 ) exp(Ax - a\H) 

SUp r < OO . 

<>o,x>o,Ae(o,A) t + exp(ex 2 - t) 

Proof. Denoting this supremum by S(a, e, A) we observe that S(a, e, A) < 
max(l, c 2 )S(c~ 2 a, c 2 e, cA) for arbitrary c > (by rescaling, x h-> cx and 
A !->■ c _1 A). Thus, we restrict ourselves to e — 1. 
We note that 

max(Ax — a\ 2 t) = . 

AeR Aat 

We choose a, (5 > such that a > 1 and /3 2 < 4a(a 2 — 1) (for instance, a = 2 
and f3 = 3y/a) and consider three cases. 
Case 1: x < ay/t. 

We note that t + exp(x 2 — t) > t + e~* > max(t, 1), thus, 
(1 + t + x 2 ) exp(Ax - aA 2 t) (1 + t + re 2 ) exp 



t + exp(x 2 — £) ~ ~ max(t, 1) 



(1 +t + a 2 t)exp^ 



a 



2 



- 4a < (2 + a 2) 

max(t, 1) 4a 



Case 2: a^t < x < (3t. 



(1 + i + x 2 ) exp(Ax - aA 2 t) (1 + t + x 2 ) exp f| 
£ + exp(x 2 — t) ~ exp(a 2 t — t) 

'f3H 2 



<(l + t + (3 2 t 2 ) exp - a 2 t + tj < 

< sup(l + * + /3 2 t 2 ) exp f- 4a< " a - - - - t) < oo . 
t>o V 4a / 

Case 3: x > /3t. 

(1 + t + x 2 ) exp (Ax - aA 2 t) 
£ + exp(x 2 — £) 

< (1 + /3 _1 x + x 2 ) exp(Ax - aA 2 £ - x 2 + t) < 

< sup(l + [i~ l x + x 2 ) exp(Ax - x 2 + /3 _1 x) < oo . 

x 

□ 

3.4 Lemma. For all a, e, A G (0, oo), 

(l + £ + x 2 )(l + exp(Ax-aA 2 £)) 

SUp r 5 r < OO . 

t>o,xeR,\e(-A,A) t + exp(ex^ - t) 
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Proof. By Lemma 13.31 applied to | x\ , | A | , 

(l+t + x 2 ) exp(|Ad - a\H) 

sup - ,1/2 T\ < 00 ' 

t>o,xeR,Ae(-A,A) * + exp(ex 2 - t) 

and Xx < \Xx\, of course. The new terms are bounded: 

i + t < 2±l< \+l < 2: 



i + exp(ex 2 — £) t + e _i max(l, t) 



x 2 x 2 1 



t + exp(ex 2 — t) t + ex 2 —t e 



□ 



Here is a counterpart of Lemma 12. 61 This time, the origin A = rj = is 
included (but its neighborhood is reduced). 

3.5 Lemma. For every a G (0, 00), maps (A, 77) >->■ exp(AX— r/r) and (A, 77) !->■ 
rexp(AX — r/r) are continuous from {(A, 77) : A G IR, 7/ G [aA 2 ,oo)} to the 
space Li of integrable random variables. 

Proof. We apply the dominated convergence theorem, taking into account 
that r + exp(eX 2 — r) is an integrable majorant by Lemma [3.41 □ 

3.6 Lemma. For all a, e,A G (0,oo), 

I exp(Ax — aA 2 t) — 1 — (Ax — aA 2 t)| 

SUp — ? ~~r < OO . 

i>o,xeR,Ae(-A,o)u(o,A) ^ [t + exp(£x 2 - t)) 

Proof. Denote u = Xx — aX 2 t. 

Case \x\ < a\X\t: we have \Xx\ < aX 2 t, thus — 2aX 2 t < u < and 
\ e ^-l- u \= e u -l-u<l-l-u = -u< 2aX 2 t < 2aX 2 (t + exp(ex 2 - 1)) . 

Case |x| > a\X\t: we apply the bound \e u — 1 — u\ < \u 2 max(l, e"), note 
that m 2 /A 2 < 2x 2 + 2(aAt) 2 < 4x 2 and get an upper bound 



x 2 



max(l, exp(Ax — aA 2 t)) 



t + exp(ex 2 — t) 



bounded by Lemma 13.41 □ 

3.7 Lemma. For all a G (0, 00), 

E exp(AX - aA 2 r) - 1 1 

— > a as A -> . 

A 2 2 
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Proof. We have 

exp(AX - aA 2 r) - 1 - (AX - a\ 2 r) 1 „ 

— ^ '— i '- -> -X 2 a.s. as A -> . 

X 2 2 

The left-hand side is dominated by r+exp(eX 2 — r) by Lemma l3~6| the majo- 
rant being integrable (for some e) by (JTJ), (J2J)- By the dominated convergence 
theorem, 

E exp(AX - aAV) - 1 -AEX + aA 2 Er 1 2 
A~2 y 2 EX ; 

it remains to use (J3J). □ 

Recall ?7a satisfying (EJ) E exp(AX— i]\t) = 1, given by Lemma l2~Tj r] = 0, 
and r]\ > for A ^ 0. 

3.8 Lemma. t)\ = |A 2 + o(A 2 ) as A -> 0. 

Proof. If a > | then by Lemma [3.71 E exp(AX — aA 2 r) < 1 and therefore 
r/x < a\ 2 for all A 7^ small enough. Similarly, if a < | then r]\ > a\ 2 for all 
A 7^ small enough. □ 

3.9 Lemma. The function A i— > is continuous from R to the space of 
measures with the norm topology. 

Proof. Continuity on (— oo, 0) U (0, oo) holds by Lemma T2.8I The same proof 
gives now continuity at due to Lemma 13751 (and 13.81) . □ 

3.10 Lemma. The set {fi\ : A G [-C, C]} satisfies the conditions of Theorem 
11.31 whenever < C < oo. 

Proof. We repeat the proof of Lemma 12.91 using Lemma 13.91 instead of 12.81 
and 13.51 instead of 12.61 □ 

Recall the functions h\(t) = e~ r?A */iA((^, oo)). Similarly to Lemma 12. 101 
we get uniform direct Riemann integrability of the set {h\ : A G [— C, C)}. 
Similarly to Lemma [2.111 the map A t- >■ h\ is continuous from R to Li(0, oo). 
Similarly to Lemma [2.12[ in the nonlattice case the map A i-> {h\{kS))^ = Q is 
continuous from R to l\. 

Proof of Theorem [7J. The first claim is given by Lemma 13.81 For the second 
claim, the proof of Theorem [2] needs only trivial modifications: [— C, C] and 
related results of Sect. |3] are used instead of [— C, — c] U [c, C] and related 
results of Sect. [2j □ 
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Proof of Theorem Ql By Theorem [21 

2- b EexpA S(i ) = | +0 (i)=i + o(l) +0 ( 1 l) 
as t — > oo, uniformly in A G [-C, 0) U (0, C]. Thus, 

lim — — In E exp \S(t) = - ; 

t-s>oo,A^0,A 2 t-s>oo \H 2 

Theorem [T] follows by the well-known Gartner (-Ellis) argument. □ 
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